Entry Name: SAS-BENSON-MC1

VAST Challenge 2016

Mini-Challenge 1

Team Information

Team members:

Student team?

No

Tools used?

Approximately how many hours were spent working on this submission in total?

180 hours

May we post your submission in the Visual Analytics Benchmark Repository after VAST Challenge 2016 is complete?

Yes

High-resolution Image

Depending on your internet connectivity the design is presented below either as a virtual reality scene or as a high resolution image. Viewing the virtual reality scene is recommended for full effect and requires support for WebVR in addition to a head mounted display.

Video

The video for this submission is hosted on YouTube.

Description

We named our design solution the Collaborative Observation and Response Environment (CORE). Our primary goal was minimizing the time spent switching between information sources so that the investigator's ability to adapt and respond to new developments is not limited by the interface.

CORE provides a virtual environment that enables rapid transition between surveillance camera observation and high-density investigation workspaces. These workspaces are collections of displays and interfaces that can be occupied by multiple investigators simultaneously. Investigators can freely travel between these workspaces. They can also be accessed by field security officers equipped with augmented reality systems or remote investigators called in to help in times of crisis.

Investigation Workspaces

The investigation workspaces are comprised of displays including: live security feeds, spatial tracking, alert management, event feeds, weather information, a calendar of events, 3D maps, and results from requested or automated searches. All can be configured and arranged to meet the needs of a particular workspace.

The 3D model of the building acts as the centerpiece for a workspace and alters it's context based on the task at hand. For example, the model may be restricted only show the casino floor or in other cases may expand to show the entire island. The investigator sits in front of the model and is surrounded by the displays which are curved to maximize the available space for displays while the investigator remains stationary.

Image showing an array of six security camera recordings from different areas of the resort including the casino floor and parking garage.
Security camera feeds are presented in an array to provide a high level overview.
Image of two lists; one a list of alerts showing how critical each is and who they are assigned to and the other showing current events such as police reports and breaking news.
Alert and event queues display actionable information and current context aggregated from all relevant sources.
Image showing a typical calendar grid layout for three months and a timeline showing key events occuring over the current day.
The current weather is presented as an icon centered above the central model and a ring around its outer edge displays the forecast. The calendar view tracks upcoming scheduled events.
Image of a network diagram showing the strong negative connection between Jobie Arlund and Sven Alzada as well as their connections to other subjects of interest.
The network view shows any known relationships between two more more subjects under investigation.
Image showing the floorplan maps of the first five floors of the hotel and resort. It is annotated with the planned path Sven Alzada will take through the building.
Annotated floor plans show a broad picture of the distribution of people and resources throughout the resort complex.
Image showing search results for queries on DMV records and FBI criminal records for Isia Vann.
Basic search interfaces are available to query the available security databases.
Blink Navigation

To facilitate rapid movement between workspaces and between monitoring we propose the concept of "blink" navigation. After selecting a target surveillance camera or workspace the navigation is triggered through a long blink by the user.

The hope is that changing the scene while the user's eyes are closed will increase transition speed and reduce motion-based disorientation. Entry into this navigation system can be triggered from any display of a security feed or from maps or a 3D model of the resort.

Image showing a mockup of how viable targets for the blink navigation are annotate with an eye icon. The bottom edge of the mockup contains a curved list of icons representign the workspaces that the user can blink into.
The blink navigation system allows for rapid and hands-free movement between live surveillance and immersive digital workspaces.
Collaboration

There are often many simultaneous and potentially unrelated occurrences that the security team needs to monitor. Workspace use can range from daily tasks like watching the casino tables to on-demand spaces for investigators to handle crisis situations. Investigators can enter workspaces freely, even if they are not present physically in the security room of the resort.

To go beyond what a physical space can provide the virtual workspaces will will appear to be centered around each investigator from their point of view and include avatars to represent other investigators present in the space. To maintain natural collaboration despite this discrepancy in perspectives any gestures from other investigators will be remapped into the current investigator's context.

Image of a diagram showing how each investigator is given a perspective of the other investigator's gestures that makes it seem as if they are all centrally placed wihtin the workspace.
Each investigator is at the center of the workspace from their perspective.
Field Security Augmented Reality

The security officers on the floor are an integral part of the investigative team as they provide mobile surveillance and reporting. Their augmented displays would provide updates from the investigators and can even allow them to temporarily enter a workspace or camera viewpoint while remaining close to the action.

Image showing a mockup of the augmented reality overal a security investiagor sees while looking out over a crowd and searching for a particular individual.
Security officers are kept in sync with the investigators through augmented reality overlays.
Physical Investigation Room

The Eubiya resort has a room dedicated to the investigator team. Even without the virtual environment this provides a space for investigators to gather and plan their division of work.

To facilitate smoother transitions into and out of the virtual environment the proposed physical room has a model of the facility in its center surrounded by a semi-circle of workstations and screens lining the walls for ambient displays. Upon entering the virtual environment from one of these workstations the position of the model in front of them can remain a constant anchor for them. The interfaces on their workstations and on the walls of the room will also be the same as the ones used in the virtual environment.

Image showing a render of the 12 foot by 20 foot room that the up to five investigators will occupy during working hours. It contains a physical model of the hotel on a podium in the middle of the room and is surrounded by five chairs equipped with virutal reality headsets and equipment.
They physical room for investigators is short on space but still provides a collaborative monitoring environment.